Say my script needs to write a data set on the disk, to be picked up later in the process. Now, imagine I want to improve the performance of this script.
Is it more efficient to:
In other words, do compress and save/use (+ their counterpart disk RW operations) share the same order of magnitude in terms of execution time?
The question is to know whether “investing” time in compress is compensated by improvement in save/use speed due to smaller memory size.
I'm interested in a generic answer, but it might help to specify that I have an SSD disk, and “regular” data sets (E+3–8 by E+1).
Is it more efficient to:
- simply save, then use the data set,
- or compress the dataset, before save, then use?
In other words, do compress and save/use (+ their counterpart disk RW operations) share the same order of magnitude in terms of execution time?
The question is to know whether “investing” time in compress is compensated by improvement in save/use speed due to smaller memory size.
I'm interested in a generic answer, but it might help to specify that I have an SSD disk, and “regular” data sets (E+3–8 by E+1).
Comment